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(54) Contents extraction system and method 

(57) A user characteristic data recording medium 
(1) previously recorded with user characteristic data 
indicative of preference for a user is detachably loaded 
on the user terminal device (2) so that the user charac- 
teristic data recorded, on the user characteristic data 
recording medium (1) is inputted to the user terminal 
unit, and thus the multimedia contents are automatically 



retrieved using the inputted user characteristic data as a 
retrieval keyword identifying characteristics of the multi- 
media contents which are of interest to the user, and the 
desired contents for the user are automatically selected 
and extracted to be displayed based on the retrieval 
results. 
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Description 

[0001] The present invention is generally relates to 
a multimedia contents extraction system and method, 
and in particular to a multimedia contents 5 
retrieval/selection system and method using a user 
description data recording medium having recorded 
with information indicative of preferences and charac- 
teristics of a user, for automatically retrieving/selecting 
and displaying the contents as expected to be desired to 
by the user from a multimedia database. The multime- 
dia database accumulates a large capacity of multime- 
dia contents such as digitized audio and/or video data, 
so that the multimedia contents suited to the preference 
of the user are selectively extracted based on the user 15 
description data recorded on the user description data 
recording medium which is used as a retrieval keyword. 
[0002] In a conventional multimedia contents 
retrieval system, a user selects a desired category, for 
example, on a menu-mode screen of a user terminal 20 
device and inputs a keyword indicating a characteristic 
or feature of desired contents to the retrieval system 
every operation time. Then, the retrieval system selec- 
tively extracts the contents including the particular key- 
word from the database and a list of the extracted 25 
contents and the contents per se are supplied and dis- 
played to the user. 

[0003] A conventional technique as mentioned 
above is disclosed in the U.S. Patent 5,794,249. In a 
configuration of this conventional system, as shown in 30 
Fig. 1 0, a large capacity of contents of various kinds and 
categories are recorded and accumulated in a recording 
tape-like or other recording medium 1 03a in a database 
103. The user controls a multimedia contents retrieval 
and display unit 102 to thereby retrieve and display 35 
desired contents. 

[0004] In order to facilitate the extraction of desired 
contents, the user inputs a keyword identifying a char- 
acteristic of the desired contents into the multimedia 
contents retrieval and display unit 102 using a keyword 40 
input unit 101 such as a keyboard input means. In this 
arrangement, contents keywords indicating specifics of 
each of a plurality of contents accumulated in the data- 
base 103 are previously extracted from the database 
and stored in the contents retrieval and display unit 1 02 45 
in a table format of the listed specifics. Upon receipt of 
the user input keyword for retrieval, the contents 
retrieval and display unit 102 compares the user input 
keyword with the contents specifics listed in the table 
and selects the contents having a coincident keyword so 
and displays a list of the selected contents. Then, the 
user selects the desired contents among from the list so 
that the desired contents are displayed and reproduced. 
[0005] In this conventional retrieval system, how- 
ever, the user is required to manually input the keyword 55 
for retrieval of the contents to be displayed by the dis- 
play unit 102 every time the contents are desired to be 
retrieved. Moreover, if the user input keyword for 



retrieval is not coincident with the keyword of the spe- 
cific of the desired contents accumulated in the data- 
base, the desired contents can not be correctly 
extracted. Thus, the conventional system has the disad- 
vantages of lacking the ability of quick retrieval and high 
accuracy. 

[0006] Accordingly, there is a need to provide a 
method and system for accurately and quickly extract- 
ing the desired contents by automatically identifying the 
contents of interest to the user without requiring the 
user to specify a keyword for a search criteria on the 
keyboard input means. 

[0007] It is an essential object of the present inven- 
tion to provide an improved multimedia contents extrac- 
tion system for automatically extracting multimedia 
contents desired by a user with high accuracy and 
reduction of time consumption. 

[0008] It is another object of the present invention to 
provide an improved multimedia contents extraction 
method of automatically extracting multimedia contents 
desired by a user with high accuracy and reduction of 
time consumption. 

[0009] It is a further object of the present invention 
to provide a user description data recording medium 
having recorded with user characteristic data adapted 
to the improved multimedia contents extraction system. 
[0010] In order to attain the objects, one aspect of 
the invention provides a multimedia contents extraction 
system which comprises: a user characteristic data 
recording medium previously recorded with user char- 
acteristic data indicative of preference for a user; a con- 
tents storage supply portion for storing a plurality of 
multimedia contents and supplying desired contents to 
the user; and a user terminal device for selectively 
extracting and displaying the desired contents for the 
user among from the plurality of multimedia contents 
stored in the contents storage supply portion, wherein 
the user characteristic data recording medium is 
detachably loaded on the user terminal device so that 
the user characteristic data recorded on the user char- 
acteristic data recording medium is inputted to the user 
terminal unit, whereby the multimedia contents are 
automatically retrieved using the inputted user charac- 
teristic data as a retrieval keyword identifying character- 
istics of the multimedia contents which are of interest to 
the user, and the desired contents for the user are auto- 
matically selected and extracted to be displayed based 
on the retrieval results. 

[001 1] In this construction, the user terminal device 
includes: a user recording medium loading portion for 
loading the user characteristic data recording medium 
and inputting the user characteristic data as the key- 
word for retrieval; a keyword reading portion for reading 
the retrieval keyword of the inputted user characteristic 
data; a retrieval and similarity evaluating portion for 
retrieving the characteristics of each of the multimedia 
contents using the retrieval keyword and evaluating a 
measure of -similarity between the user characteristic 
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data and the characteristics of each of the contents; and 
a contents selection and extraction portion for selec- 
tively extracting the multimedia contents evaluated to be 
similar to the user characteristic data based on the sim- 
ilarity evaluation results. 5 
[0012] Another aspect of the invention provides a 
user characteristic data recording medium adapted to a 
multimedia contents extraction system including a user 
terminal device which automatically selects and extracts 
multimedia contents which are of interest to a user w 
among from a plurality of multimedia contents previ- 
ously accumulated in a contents storage supply portion, 
the user characteristic data recording medium being 
previously recorded with user characteristic data indica- 
tive of preference for a user, wherein the user character- is 
istic data recording medium is detachably loaded on the 
user terminal device so that the user characteristic data 
recorded on the user characteristic data recording 
medium is inputted to the user terminal device, whereby 
the multimedia contents are automatically retrieved 20 
using the inputted user characteristic data as a retrieval 
keyword identifying characteristics of the multimedia 
contents which are of interest to the user, and the 
desired contents for the user are automatically selected 
and extracted to be displayed based on the retrieval 25 
results. 

[0013] A further aspect of the invention provides a 
multimedia contents extraction method comprising 
steps of: inputting user characteristic data indicative of 
preference of a user; searching multimedia contents 30 
desired by the user among a plurality of multimedia con- 
tents accumulated in a multimedia database using the 
inputted user characteristic data as a retrieval keyword 
so that automatic personalized extraction of the con- 
tents for the user preference is performed based on the 35 
retrieval results. 

[0014] In this multimedia contents extraction . 
method, user desired multimedia contents are automat- 
ically selected and extracted among from a plurality of 
multimedia contents previously accumulated in a con- 40 
tents storage supply portion using a user characteristic 
data recording medium previously recorded with user 
characteristic data which is indicative of preference for a 
user. The method comprises: inputting and reading the 
user characteristic data previously recorded on the user 45 
characteristic data recording medium by loading the 
user characteristic data recording medium on a user ter- 
minal device; automatically retrieving the multimedia 
contents using the inputted user characteristic data as a 
retrieval keyword identifying characteristics of the multi- 50 
media contents which are of interest to the user; and 
automatically selecting and extracting the user desired 
contents to be displayed based on the retrieval results. 
[0015] The foregoing and other features, aspects 
and advantages of the invention will become better 55 
understood with regard to the following description, 
appended claims and accompanying drawings in which: 



Fig. 1 is a block diagram showing a generic config- 
uration of a multimedia contents automatic extrac- 
tion system according to the present invention; 
Fig. 2 is a block diagram showing a configuration of 
a multimedia contents automatic retrieval system 
according to a first embodiment of the present 
invention; 

Rg. 3 is a table view showing an example of the 
user description data according to the present 
invention; 

Rg. 4 is a diagram showing a table of characteristic 
data extracted from multimedia contents according 
to the present invention; 

Rg. 5 is a block diagram showing a configuration of 
a multimedia broadcast contents selecting system 
according to a second embodiment of the present 
invention; 

Rg. 6 is a diagram showing a table of characteristic 
data extracted from multimedia contents in broad- 
cast according to the second embodiment; 
Rg. 7 is a block diagram showing a configuration of 
a multimedia contents transmission and receiving 
system according to a third embodiment of the 
present invention; 

Rg. 8 is a flowchart showing an operation of a mul- 
timedia contents automatic extraction system 
according to the present invention; 
Rg. 9 is a table view showing another example of 
the user description data according to the present 
invention; and 

Rg. 10 is a block diagram showing a configuration 
of a conventional multimedia contents retrieval sys- 
tem. 

[0016] The following describes the preferred 
embodiments of a multimedia contents extraction sys- 
tem according to the present invention with reference to 
the accompanying drawings. In this context, it is noted 
that the term "multimedia contents extraction system- 
gives a generic name of a multimedia contents retrieval 
and display system, broadcast contents automatic 
selection receiver display system, and multimedia con- 
tents automatic selective supply or transmission/receiv- 
ing system. 

[0017] Fig. 1 shows a block configuration example 
of a multimedia contents extraction system according to 
a generic embodiment of the present invention, in this 
construction, the multimedia contents extraction system 
is a combination of a user terminal device 2 and multi- 
media contents storage supply portion 3 using a user 
description data recording medium 1 adapted thereto. 
The user description data recording medium 1 is previ- 
ously recorded with user description data which serves 
as basic data of a retrieval keyword for identifying char- 
acteristics and preferences of a user, it is noted here 
that the user description data is also referred to as 'user 
characteristic data" hereinafter. 

[0018] The user description data recording medium 
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1 is detachably loaded on the user terminal device 2 to 
input the user description data for use as the retrieval 
keyword. The user terminal device 2 is connected to the 
multimedia contents storage supply portion 3 which 
includes a multimedia database 3a for storing a large 5 

capacity of multimedia contents of various categories to 

be selectively extracted, so that the contents data can 
be transmitted and received between each of the user 
terminal devices and an external host computer (not 
shown) and the like. w 

[001 9J By this arrangement, the user description 
data indicative of characteristics and preference of a 
user is inputted for automatically searching multimedia 
contents desired by the user among the plurality of mul- 
timedia contents accumulated in the multimedia data- is 
base using the inputted user characteristic data as the 
retrieval keyword so that automatic personalized extrac- 
tion and display of the contents for the user preference 
can be performed based on the retrieval results. 
[0020J The user-terminal device 2 includes a user 20 
recording medium loading portion 4 for detachably load- 
ing the user description data recording medium 1 and 
inputting the user characteristic data as the keyword for 
retrieval and a keyword reading portion 5 for reading the 
retrieval keyword of the inputted user characteristic 25 
data. The user terminal device 2 further includes a 
retrieval and similarity evaluating portion 6 for retrieving 
the characteristics or specifics of each of the multimedia 
contents with reference to the inputted retrieval keyword 
and evaluating a measure of similarity between the user 30 
characteristic data and the characteristics of each of the 
contents. The user terminal device 2 further includes a 
contents selection and extraction portion 7 for selec- 
tively extracting the multimedia contents evaluated to be 
analogous or similar to the user characteristic data 35 
based on the similarity evaluation results. The resultant 
selectively extracted multimedia contents are displayed 
on a display unit (not shown) of the user terminal device 
2. The operation of the multimedia contents automatic - 
extraction system is controlled by a controller 8 which is 40 
provided in the user terminal device 2 in this embodi- 
ment; 

[0021] It is noted here that the keyword reading por- 
tion 5, retrieval and similarity evaluating portion 6, con- 
tents selection and extraction portion 7 and controller 8 45 
may be provided in the side of the multimedia contents 
storage supply portion 3 instead of providing in the side 
of the user terminal device 2. 

FIRST EMBODIMENT 50 

[0022J Fig. 2 shows a block configuration of a multi- 
media contents retrieval system for realizing a multime- 
dia contents automatic retrieval system according to the 
first embodiment which is a modification of the multime- 55 
dia contents extraction system shown in Fig. 1. 
[0023] In this embodiment in comparison to the 
generic embodiment shown in Fig. 1, the contents stor- 



age supply portion 3 is comprised of a multimedia data- 
base and the user terminal device 2 is comprised of a 
multimedia contents retrieval portion 9 for retrieving the 
characteristics or specifics of the multimedia contents 
accumulated in the database 3 to thereby automatically 
retrieve the user, desired, contents coincident with the 
preference of the user. 

[0024] The multimedia database 3 is normally com- 
prised of a large capacity contents accumulation unit 
such as a hard disk for storing a vast amount of com- 
pressed multimedia contents of various categories. 
Each of the multimedia contents has contents charac- 
teristic data attached thereto serving as information rep- 
resenting the specifics of the contents. As the contents 
characteristic data/ as shown in Fig. 4, items of lan- 
guage under usage, title and representative keyword of 
contents and the like are attached to and associated 
with each of the contents 1 , 2 and 3. 
[0025] Fig. 3 shows an example of the user charac- 
teristic data according to this embodiment. In this exam- 
ple, the characteristics and preferences of a user are 
items of such as nationality, address, sex, age, occupa- 
tion, field of specialty, hobby, special skill, family mem- 
ber and annual income. These items of the user 
characteristic data are recorded beforehand in the user 
description data recording medium which is realized by, 
for example, an IC card, magnetic card, optical card, 
magnetic disk or optical disk. 

[0026] In this arrangement, the user description 
data recording medium 1 may be comprised of a fixed 
memory region and a variable memory region, where 
the fixed memory region is for recording quasi-fixed 
items such as nationality, address, sex, occupation, field 
of specialty and family member, and the variable mem- 
ory region is for recording variable items such as age, 
hobby, special skill, and annual income. 
[0027] Moreover, the user characteristic data may 
further include items of essential data for psychologi- 
cally evaluating preferences or characteristics of the 
user other than the above listed items. 
[0028] In the construction of the multimedia con- 
tents retrieval system as shown, in Fig. 2, the following 
describes a method of automatically extracting the 
expected contents to be coincident with the desired or 
interested, contents for the user among from the multi- 
media contents accumulated in the multimedia contents 
database 3. 

[0029] The multimedia contents retrieval portion 9 
includes a contents characteristic data table forming 
unit 9a and priority evaluating unit 9b. Initially, the con- 
tents characteristic data table forming unit 9a extracts 
the representative keywords representing the specifics 
regarding to the usage language, title and contents 
associated with each of the multimedia contents from 
the plurality of multimedia contents accumulated in the 
database 3 and produces a list table of the contents 
characteristic data as shown in Fig. 4 to be held therein. 
[0030] Then, upon application of the user descrip- 
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tion data recording medium 1 having recorded with user 
characteristic data to be loaded to the multimedia con- 
tents retrieval portion 9, each item of the inputted user 
characteristic data as shown in Fig. 3 is compared with 
the representative keywords of the listed contents char- 
acteristic data table as shown in Fig. 4 where the input- 
ted user characteristic data is used as the retrieval 
keyword. Thus, the names of the contents are deter- 
mined in the descending order of the number of the key- 
words of a larger degree of coincidence or analogy so 
that the determined contents characteristic data is suc- 
cessively extracted and displayed. 
[0031] The priority evaluating unit 9b has a similar- 
ity evaluating or priority weighing function for retrieving 
the characteristics or specifics of each of the multimedia 
contents and evaluating a measure of similarity 
between the user characteristic data and the character- 
istics of each of the contents. Thus, the multimedia con- 
tents evaluated to be analogous or similar to the user 
characteristic data are selectively extracted based on 
the priority evaluation results. The contents characteris- 
tic data table forming unit 9a and priority evaluating unit 
9b may be provided in the similarity evaluating portion 6 
or contents selection extraction portion 7 in the generic 
construction shown in Fig. 1. 

[00321 In this operation, it is noted here that the 
names of the contents may be displayed so that the 
user may selects the desired contents therefrom to be 
displayed or reproduced. Alternatively, instead of dis- 
playing the list of the contents characteristic data table, 
the contents evaluated to be analogous to the user pref- 
erence may be automatically and directly generated to 
be displayed in the descending order based on a match- 
ing degree of the evaluation measure. 
[0033] The similarity or priority evaluation is carried 
out in a manner as below. In the embodiment using the 
user characteristic data as shown in Rg. 3, the national- 
ity of the use is Japan, and therefore the desirable lan- 
guage of the contents is determined to be Japanese, 
and the contents containing the term "Japan" in the con- 
tents characteristic data table shown in Fig. 4 are 
searched and identified. Since the contents 3 contains 
the term "Japanese" in the contents characteristic data 
table and the term contains the term "Japan", the prior- 
ity weight is added by one to the contents 3 meeting this 
requirement. Then, since the address of the user is in 
Osaka, the contents relating to Osaka are determined 
as desirable, and the weight is added by another one to 
the contents 3 having the title meeting this requirement. 
[0034] Then, the presence or absence of the con- 
tents relating to the items of sex and age is examined, 
and since there are no contents meeting this require- 
ment, no weight is added to any contents. 
[0035] Then, since the occupation is a salaried 
man, the contents relating to a company are determined 
as desirable. Although there are no contents containing 
the term "salaried man" in the contents characteristic 
data table, the contents 3 includes the relating term 



"company" regarding the item of Contents, and there- 
fore the weight 1 (one point) is added to the contents 3 
having the representative keyword "Company A" meet- 
ing this requirement 
5 [0036] Further, the field of specialty of the user is a 
computer software, the contents relating to a computer 
or software are determined as desirable, and the con- 
tents containing the term "computer" or "software" in the 
contents characteristic data table are searched. Since 
10 the contents 3 include a part "soft" thereof, another 
weight 1 (one point) is added to the contents 3 having a 
representative keyword "software" meeting this require- 
ment. 

[0037] Then, since the hobby of the user is a travel, 
15 the contents, relating to the travel are determined as 
desirable, and the weight 1 (one point) is added to the 
contents 2 having a particularly similar keyword Trip" in 
the characteristic data thereof. Also, the special skill of 
the user is English conversation, the contents relating to 
20 "English" are determined as desirable, and since the 
contents 2 includes the term "English" relating to the 
Language meeting this requirement, the weight 1 is 
added to the contents 2. 

[0038] Then, the presence or absence of the con- 
25 tents relating to the family make-up member is deter- 
mined based on the actual family of the user. In this 
example, there are no contents meeting this require- 
ment, and no weight is added to any contents, Neither is 
there any contents meeting the requirement of annual 
30 income, and therefore there is no weight added for this 
item. 

[0039] As a result of the foregoing evaluation proc- 
ess, the priority weight is 0 point for the contents 1, 2 
points for the contents 2, and 4 points for the contents 3. 
35 Thus, the contents 3 are determined most desirable, 
and the contents characteristic data relating to the lan- 
guage, title and contents of the Contents 3 are first dis- 
played and outputted to the user. The contents 2 are 
determined as the next most desirable, and the contents 
40 characteristic data thereof are secondly displayed and 
outputted. The contents 1 have weight 0 point, and 
therefore the contents characteristic data thereof are 
not displayed. 

[0040] It is noted here that, in the case where the 
45 retrieval keyword of the user characteristic data is not 
completely coincident with the representative keyword 
of the contents characteristic data but is partially 
matched therewith, the priority weight point to be added 
may be varied as 0.5, 0.3 and the like. Moreover, there 
50 may be accommodated a synonym dictionary for hold- 
ing similar word clusters provided in the similarity evalu- 
ation unit (6, 9b) so that the retrieval keyword can be 
automatically transcribed to another synonym on the 
cluster when retrieving the contents characteristic data 

55 list. 

[0041] By this operation described above, the auto- 
matic retrieval and display of the contents considered 
desirable for the user can be realized, and the user can 
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audio-visually and selectively enjoy the contents 3 or 2 
by watching the display as desired at anywhere and any 
time. 

SECOND EMBODIMENT 

[0042] Fig. 5 shows a block configuration of a multi- 
media contents broadcast receiving system for realizing 
a multimedia contents automatic selective broadcast 
receiving system according to the second embodiment 
which is another modification of the multimedia contents 
extraction system shown in Fig. 1 . 
[0043] In this embodiment in comparison to the 
generic embodiment shown in Fig. 1, the contents stor- 
age supply portion 3 is comprised of a multimedia 
broadcast transmitter system 1 1 including a database 
3a and the user terminal device 2 is comprised of a mul- 
timedia broadcast receiver portion 10 for automatically 
selecting and receiving the user desired broadcast con- 
tents coincident with the preference of the user using a 
user description data recording medium 1 adapted 
thereto. * 

[0044] The multimedia broadcast transmitter sys- 
tem 1 1 may include a multimedia database 3a storing a 
vast amount of compressed multimedia contents of var- 
ious categories which are synchronously broadcasted 
via a plurality of channels. Each channel has keywords 
or the like representative information relating to items of 
language under usage, title and representative keyword 
of contents and the like which are attached to and asso- 
ciated with each of the broadcast contents. Moreover, 
each channel is assumed to periodically broadcast a list 
of programs as shown in Fig. 6 for each time. 
[0045] In the multimedia broadcast receiving sys- 
tem, a method of automatically selecting and receiving 
a broadcast program desired by the user will be 
explained below. 

[0046] The multimedia broadcast receiving portion 

10 includes a broadcast contents characteristic data 
table forming unit 10a and a priority evaluation unit 10b 
and receives the program table of each channel broad- 
casted by the multimedia broadcast transmitter system 

1 1 and holds the program table as a broadcast contents 
characteristic data table for each channel as shown in 
Fig. 6. 

[0047] Then, upon application of the user descrip- 
tion data recording medium 1 having recorded with user 
characteristic data to be loaded to the multimedia 
broadcast receiver portion 10, each item of the inputted 
user characteristic data as shown in Fig. 3 is compared 
with the representative keywords of the contents char- 
acteristic data listed in the program table as shown in 
Fig. 6 where the inputted user characteristic data is 
used as the retrieval keyword. Thus, the names of the 
contents are determined in the descending order of the 
number of the keywords of a larger degree of coinci- 
dence or analogy so that the determined broadcast con- 
tents are automatically selected and successively 



displayed. 

[0048] The priority evaluation process is the same 
as that of the first embodiment. 

[0049] As a result of the foregoing evaluation proc- 
5 ess, for example, the contents 3 are determined most 
desirable, and the contents characteristic data relating 
to the language, title and contents of the Contents 3 are 
first displayed and outputted to the user. The contents 2 
are determined as the next most desirable, and the con- 
to tents characteristic data thereof are secondly displayed 
and outputted. 

[0050] By this operation described above, the auto- 
matic selection and display of the broadcast program of 
contents considered desirable for the user can be real- 
15 ized, and the user can audio-visually and selectively 
enjoy the contents 3 or 2 by watching the display as 
desired. 

[0051 ] In this broadcast receiving system, the multi- 
media broadcast receiver portion is connected to the 

20 multimedia broadcast system and the multimedia 
broadcast receiver portion is loaded with the user char- 
acteristic data recording medium to input the user char- 
acteristic data and automatically choose the user 
desired program of contents among from the multime- 

25 dia broadcast contents using the inputted user charac- 
teristic data as a retrieval keyword so that automatic 
personalized selection of the program contents for the 
user preference is realized based on the retrieval 
results. 

30 

THIRD EMBODIMENT 

[0052] Fig. 7 shows a block configuration of a multi- 
media contents transmission and receiving system 

35 according to the third embodiment which is further 
another modification of the multimedia contents extrac- 
tion system shown in Fig. 1. The multimedia contents 
transmission and receiving system is a combination of a 
multimedia contents receiver portion 12 and a multime- 

40 dia contents supply portion 1 3 connected thereto, using 
a user description data recording medium 1 adapted 
thereto. 

[0053] In this embodiment in comparison to the 
generic embodiment shown in Fig. 1, each user termi- 

45 nal device 2 has a function of the multimedia contents 
receiver portion 12, and the multimedia contents supply 
portion 1 3 corresponding to the contents storage supply 
portion 3 is provided with the retrieval keyword reading 
portion 5, retrieval similarity evaluating portion 6, con- 

so tents selection portion 7 and controller 8 together with 
the database 3a. 

[0054] The multimedia contents supply portion 1 3 is 
normally comprised of a large capacity contents accu- 
mulation unit for storing a vast amount of compressed 
55 multimedia contents of various categories. Each of the 
multimedia contents has contents characteristic data 
attached thereto serving as information representing 
the specifics of the contents. As shown in Fig. 4, items 
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of language under usage, title and representative key- 
word of contents and the like are attached to and asso- 
ciated with each of the contents 1 , 2 and 3. 
[0055] In this construction, a method of automati- 
cally selecting and transmitting/receiving the user 
desired contents will be explained below. 
[0056] The multimedia contents supply portion 13 
includes a contents characteristic data table forming 
unit 13a and a priority evaluating unit 13b and extracts 
the contents characteristic data such as the representa- 
tive keywords relating to the items of the usage lan- 
guage, title and contents representing the specific 
characteristics of contents attached to each of the mul- 
timedia contents stored in the database, to thereby con- 
stitute the contents characteristic data table as shown in 
Fig. 4 to be held in the contents characteristic data table 
forming unit 13a. 

[0057] - - Then, upon application of the user descrip- 
tion data recording medium 1 having recorded with user 
characteristic data to be loaded to the multimedia con- 
tents receiver portion 12, the multimedia contents sup- 
ply portion 13 reads the user characteristic data 
inputted to the contents receiver portion 12 therefrom 
and selects the user desired contents using the inputted 
user characteristic data as the retrieval keyword by 
comparing the retrieval keywords of the user character- 
istic data and the representative keywords of the con- 
tents characteristic data by means of the priority 
evaluating unit 13b. Thus, the selected user desired 
contents are transmitted from the contents supply por- 
tion 13 to the contents receiver portion 12 to be dis- 
played to the user. 

[0058] In this evaluation process, the names of the 
contents are determined in the descending order of the 
number of occurrences of the keywords having a larger 
degree of coincidence or. analogy so that the deter- 
mined contents are automatically selected and succes- 
sively displayed. The priority evaluation process is the 
same as those of the first and second embodiments. 
[0059] As a result of the foregoing evaluation proc- 
ess, for example, the contents 3 are determined most 
desirable, and the contents characteristic data relating 
to the language, title and contents of the Contents 3 are 
first displayed and outputted to the user. The contents 2 
are determined as the next most desirable, and the con- 
tents characteristic data thereof are secondly displayed 
and outputted. 

[0060] By this operation described above, the auto- 
matic transmission and receiving of the contents con- 
sidered desirable for the user can be realized, and the 
user can audio-visually and selectively enjoy the con- 
tents 3 or 2 by watching the display as desired. 
[0061] Each operation process described above 
can be realized as a computer program and the means 
for executing the same can be realized by a computer- 
implemented method. 

[0062] Fig. 8 shows a flow chart for explaining the 
same process. In step S21, the multimedia contents 



retrieval portion 9, multimedia broadcast receiver por- 
tion 10 or multimedia contents supply portion 13 reads 
out the contents specific information of the representa- 
tive keywords relating to the language, title and contents 
5 associated with each of the multimedia contents stored 
in the database to produce a contents characteristic 
data table for each contents as shown in Figs. 4 and 6. 
[0063] In step S22, the retrieval keyword reading 
portion 5 provided in the user terminal device 2 or mul- 
w timedia contents storage supply portion 3 reads the 
user characteristic data indicative of the characteristics 
and preferences of the user when the user description 
data recording medium 1 is loaded to the user terminal 
device 2. Then, the retrieval similarity evaluating portion 
15 6 compares the inputted retrieval keywords of the user 
characteristic data with the representative keywords of 
each item listed in the contents characteristic data table. 
In this way, the user desired contents are selected in the 
descending order of the number of occurrences of coin- 
20 cident or analogous keywords, so that the contents 
characteristic data of the selected contents is displayed 
to the user. In view of the displayed results, the user 
selects and audio-visually enjoys the desired contents, 
thereby realizing the automatic retrieval or selection of 
25 the multimedia contents. 



FOURTH EMBODIMENT 

[0064] • Fig. 9 shows another example of the user 
30 characteristic data list according to the fourth embodi- 
ment. The difference from the user characteristic data 
shown in - Fig. 3 resides in the fact that, in this fourth 
embodiment, an item of audio-visual history is added to 
the items of nationality, address, sex, age, occupation 
35 specialty, hobby, special skill, family member, and 
annual income. As the audio-visual history, every time 
the user actually extracted the contents in the past, the 
contents characteristic data thereof is. sequentially 
added as a user characteristic data set to be recorded 
40 to the user description data recording medium 1 . A re- 
writeable recording medium is used as the user descrip- 
tion data recording medium 1 similarly to the first 
embodiment. 

[0065] Once the audio-visual history is recorded to 
45 the user description data recording medium 1 , when the 
same user description data recording medium 1 is used 
next time and thereafter for retrieving the multimedia 
contents, the coincidence or similarity measure of the 
contents characteristic data is evaluated in the same 
so manner as described in the first embodiment with 
respect to all of the user characteristic items and the 
addition recorded item of the audio-visual history. In this 
arrangement, once a user characteristic item is used for 
retrieval, the used item is accumulated in addition as a 
55 new characteristic data sets 3, 4, ... in the audio-visual 
history region. 

[0066] In the similarity evaluation process, when 
there are contents completely coincident with any of the 
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characteristic data sets recorded in the audio-visual his- 
tory region, the priority weight of the contents is set to, 
for example, 0 point. Also, when the number of the char- 
acteristic data sets exceeds a predetermined number, 
the characteristic data set is deleted in the order from 
the oldest one. 

[0067] By this arrangement, the multimedia retrieval 
system gives priority to display the contents expected to 
be coincident with the preferences of the user, taking 
account of the user's past preferences. Moreover, since 
the priority weight of the contents once extracted in the 
past is set to 0 point, the contents already used in the 
past is avoided from being displayed. 
[0068] As described above, according to the first 
aspect of the present invention, a multimedia contents 
extraction system comprises: a user characteristic data 
recording medium previously recorded with user char- 
acteristic data indicative of preference for a user; a con- 
tents storage supply portion for storing a plurality of 
multimedia contents and supplying desired contents to 
the user; and a user terminal device for selectively 
extracting, and displaying the desired contents for the 
user among from the plurality of multimedia contents 
stored in the contents storage supply portion, wherein 
the user characteristic data recording medium is 
detachably loaded on the user terminal device so that 
the user characteristic data recorded on the user char- 
acteristic data recording medium is inputted to the user 
terminal unit, whereby the multimedia contents are 
automatically retrieved using the inputted user charac- 
teristic data as a retrieval keyword identifying character- 
istics of the multimedia contents which are of interest to 
the user, and the desired contents for the user are auto- 
matically selected and extracted to be displayed based 
on the retrieval results. 

[0069] In this construction, the user terminal device 
includes: a user recording medium loading portion for 
loading the user characteristic data recording medium 
and inputting the user characteristic data as the key- 
word for retrieval; a keyword reading portion for reading 
the retrieval keyword of the inputted user characteristic 
data; a retrieval and similarity evaluating portion for 
retrieving the characteristics of each of the multimedia 
contents using the retrieval keyword and evaluating a 
measure of similarity between the user characteristic 
data and the characteristics of each of the contents; and 
a contents selection and extraction portion for selec- 
tively extracting the multimedia contents evaluated to be 
similar to the user characteristic data based on the sim- 
ilarity evaluation results. 

[0070] By this arrangement, the contents desirable 
to the user can be selectively retrieved to be displayed 
without requiring the user to input the contents charac- 
teristic data on a keyboard, and thus the user can easily 
and quickly extract the contents which are of interest to 
the user. 

[0071] According to a second aspect of the present 
invention, a user characteristic data recording medium 



is adapted to a multimedia contents extraction system 
including a user terminal device which automatically 
selects and extracts multimedia contents which are of 
interest to a user among from a plurality of multimedia 

5 contents previously accumulated in a contents storage 

• ■ supply . portion, the .user characteristic data, recording 
medium being previously recorded with user character- 
istic data indicative of preference for a user, wherein the 
user characteristic data recording medium is detachably 

w loaded on the user terminal device so that the user 
characteristic data recorded on the user characteristic 
data recording medium is inputted to the user terminal 
device, whereby the multimedia contents are automati- 
cally retrieved using the inputted user characteristic 

75 data as a retrieval keyword identifying characteristics of 
the multimedia contents which are of interest to the 
user, and the desired contents for the user are automat- 
ically selected and extracted to be displayed based on 
the retrieval results. 
20 [0072] By this arrangement, the user description 
data recording medium can be portably brought with 
anywhere, and the automatic retrieval of contents 
desired by the user can be realized. 
[0073] According to a third aspect of the present 
25 invention, a multimedia contents extraction method 
comprises the steps of: inputting user characteristic 
data indicative of preference of a user; searching multi- 
media contents desired by the user among a plurality of 
multimedia contents accumulated in a multimedia data- 
30 base using the inputted user characteristic data as a 
retrieval keyword so that automatic personalized extrac- 
tion of the contents for the user preference is performed 
based on the retrieval results. 

[0074] By this method, the user description data 
35 indicative of characteristics and preference of a user is 
inputted for automatically searching multimedia con- 
tents desired by the user using the inputted user char- 
acteristic data as the retrieval keyword so that automatic 
personalized extraction and display of the contents for 
40 the user preference can be performed anywhere in the 
world. 

[0075] According to a fourth aspect of the present 
invention, a multimedia contents extraction method for 
automatically selecting and extracting user desired mul- 

45 timedia contents among from a plurality of multimedia 
contents previously accumulated in a contents storage 
supply portion using a user characteristic data record- 
ing medium previously recorded with user characteristic 
data which is indicative of preference for a user, the 

50 method comprises the steps of: inputting and reading 
the user characteristic data previously recorded on the 
user characteristic data recording medium by loading 
the user characteristic data recording medium on a user 
terminal device; automatically retrieving the multimedia 

55 contents using the inputted user characteristic data as a 
retrieval keyword identifying characteristics of the multi- 
media contents which are of interest to the user; and 
automatically selecting and extracting the user desired 
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contents to be displayed based on the retrieval results. 
[0076] According to a fifth aspect of the present 
invention, the contents storage supply portion is com- 
prised of a database and the user terminal device is 
comprised of a contents retrieval portion for retrieving 
the characteristics of the multimedia contents accumu- 
lated in the database to thereby automatically retrieve 
the user desired contents coincident with the preference 
of the user. 

[0077] According to a sixth aspect of the present 
invention, the contents storage supply portion is com- 
prised of a multimedia broadcast system for broadcast- 
ing a plurality of multimedia contents and the user 
terminal device is comprised of a multimedia broadcast 
receiver portion for automatically and selectively receiv- 
ing the user desired contents coincident with the prefer- 
ence of the user among from the multimedia broadcast 
contents- transmitted from the multimedia broadcast 
system. 

[0078] By this arrangement, the broadcast program 
of the contents desirable to the user can be automati- 
cally selected to be displayed without requiring the user 
to input the contents characteristic data on a keyboard 
and the user can enjoy the broadcast program coinci- 
dent with the preference of the user. 
[0079] In this arrangement, the multimedia broad- 
cast receiver portion is connected to the multimedia 
broadcast system and the multimedia broadcast 
receiver portion is loaded with the user characteristic 
data recording medium to input the user characteristic 
data and automatically choose the user desired con- 
tents among from the multimedia broadcast contents 
using the inputted user characteristic data as a retrieval 
keyword so that automatic personalized extraction of 
the contents for the user preference is performed based 
on the retrieval results. 

[0080] By this arrangement, the user description 
data indicative of characteristics and preference of a 
user is inputted for automatically searching multimedia 
broadcast contents desired by the user using the input- 
ted user characteristic data as the retrieval keyword so 
that automatic personalized selection and display of the 
broadcast contents for the user preference can be per- 
formed anywhere in the world. 

[0081 ] According to a seventh aspect of the present 
invention, the contents storage supply portion is com- 
prised of a contents supply portion including a database 
accumulating a plurality of multimedia contents to be 
extracted, and the user terminal device is comprised of 
a contents receiver portion for receiving the multimedia 
contents transmitted from the contents supply portion, 
wherein the contents supply portion reads the user 
characteristic data inputted to the contents receiver por- 
tion therefrom and selects the user desired contents 
using the inputted user characteristic data as the 
retrieval keyword, whereby the selected user desired 
contents are transmitted to the contents receiver portion 
from the contents supply portion. 



[0082] By this arrangement, the multimedia con- 
tents supply portion may selectively supply the informa- 
tion of the contents coincident with the preference of the 
user, and transmission channels can be * effectively 
5 used. 

[0083] According to an eighth aspect of the present 
invention, the user characteristic data previously 
recorded on the user characteristic data recording 
medium is inputted to the multimedia broadcast receiver 
10 portion, whereby the multimedia broadcast receiver por- 
tion automatically retrieves the multimedia broadcast 
contents using the inputted user characteristic data as a 
retrieval keyword identifying characteristics of the multi- 
media broadcast contents which are of interest to the 
is user, and, based on the retrieval results, the user 
desired contents are automatically selected among 
from the multimedia broadcast contents transmitted 
from the multimedia broadcast system. 
[0084] By this arrangement, the user description 
20 data recording medium can be portably brought with 
anywhere, and the automatic selection of the broadcast 
contents desired by the user can be realized. 
[0085] In the first to eighth aspects, the user char- 
acteristic data is comprised of at least one combination 
25 of nationality, address, sex, age, occupation, field of 
specialty, hobby, special skill, family constituent and 
annual income. 

[0086] By this arrangement, the preferences of the 
user can be represented as a generic keyword and the 
30 coincidence comparison between the retrieval keyword 
and the contents characteristic keyword can be objec- 
tively evaluated. Therefore, regardless of the type of the 
retrieval or receiving means and the database, more 
versatile retrieval and selection can be realized. 
35 [0087] In this arrangement, the user characteristic . 
data may include data of audiovisual extraction, history 
of the contents of which the extraction was recorded in 
the past. Moreover, the data of the audiovisual extrac- 
tion history may include a characteristic data set in each 
40 contents and wherein the contents coincident to any of 
the characteristicdata set are not selected. 
[0088] By this arrangement, the multimedia retrieval 
system gives priority to display the contents expected to 
be coincident with the preferences of the user, taking 
45 account of the user's past preferences. Moreover, since 
the priority weight of the contents once extracted in the 
past is set to 0 point, the contents already used in the 
past is avoided from being displayed. 
[0089] As described above, according to the 
so present invention, there can be provided an improved 
multimedia contents extraction system and method for 
automatically extracting multimedia contents desired by 
a user with high accuracy and reduction of time con- 
sumption. Thus, accurate and quick extraction of the 
55 desired contents can be realized by automatically iden- 
tifying the contents of interest to the user without requir- 
ing the user to specify a keyword for a search criteria on 
a keyboard input means. 



9 



17 



EP 1 052 578 A2 



18 



Claims 

1. A multimedia contents extraction system compris- 
ing: 

5 

a user characteristic data recording medium (1 ) 
previously recorded with user characteristic 
data (Figs. 3, 9) indicative of preference for a 
user; 

a contents storage supply portion (3) for storing w 
a plurality of multimedia contents and supply- 
ing desired contents to the user; and 
a user terminal device (2) for selectively 
extracting and displaying the desired contents 
for the user among from the plurality of multi- 75 
media contents stored in the contents storage 
supply portion (3), 

wherein the user characteristic data recording 
medium (1) is detachably loaded on the user 
terminal device (2) so that the user characteris- 20 
tic data recorded on the user characteristic 
data recording medium (1) is inputted to the 
user terminal unit, whereby the multimedia 
contents are automatically retrieved using the 
inputted user characteristic data as a retrieval 25 
keyword identifying characteristics of the multi- 
media contents which are of interest to the 
user, and the desired contents for the user are 
automatically selected and extracted to be dis- 
played based on the retrieval results. 30 

2. The multimedia contents extraction system accord- 
ing to claim 1, wherein the user terminal device (2) 
includes: a user recording medium loading portion 

(4) for loading the user characteristic data recording 35 
medium (1) and inputting the user characteristic 
data as the keyword for retrieval; a keyword reading 
portion (5) for reading the retrieval keyword of the 
inputted user characteristic data; a retrieval and 
similarity evaluating portion (6) for retrieving the 40 
characteristics of each of the multimedia contents 
using the retrieval keyword and evaluating a meas- 
ure of similarity between the user characteristic 
data and the characteristics of each of the contents; 
and a contents selection and extraction portion (7) 45 
for selectively extracting the multimedia contents 
evaluated to be similar to the user characteristic 
data based on the similarity evaluation results. 

3. A user characteristic data recording medium (1) so 
adapted to a multimedia contents extraction system 
including a user terminal device (2) which automat- 
ically selects and extracts multimedia contents 
which are of interest to a user among from a plural- 
ity of multimedia contents previously accumulated 55 
in a contents storage supply portion (3), the user 
characteristic data recording medium (1 ) being pre- 
viously recorded with user characteristic data (Figs. 



3, 9) indicative of preference for a user, 
wherein the user characteristic data recording 
medium (1) is detachably loaded on the user termi- 
nal device (2) so that the user characteristic data 
recorded on the user characteristic data recording 
medium (1) is inputted to the user terminal device, 
whereby the multimedia contents are automatically 
retrieved using the inputted user characteristic data 
as a retrieval keyword identifying characteristics of 
the multimedia contents which are of interest to the 
user, and the desired contents for the user are auto- 
matically selected and extracted to be displayed 
based on the retrieval results. 

4. A multimedia contents extraction method for auto- 
matically selecting and extracting user desired mul- 
timedia contents among from a plurality of 
multimedia contents previously accumulated in a 
contents storage supply portion (3) using a user 
characteristic data recording medium (1) previously 
recorded with user characteristic data which is- 
indicative of preference for a user, the method com- 
prising: 

inputting and reading the user characteristic 
data previously recorded on the user charac- 
teristic data recording medium (1) by loading 
the user characteristic data recording medium 
(1) on a user terminal device (2); 
automatically retrieving the multimedia con- 
tents using the inputted user characteristic data 
as a retrieval keyword identifying characteris- 
tics of the multimedia contents which are of 
interest to the user; and 

automatically selecting and extracting the user 
desired contents to be displayed based on the 
retrieval results. --- 

5. The multimedia contents extraction system accord- 
ing to claim 1 or 2, wherein the contents storage 
supply portion (3) is comprised of a database (3a) 
and the user terminal device (2) is comprised of a 
contents retrieval portion (9) for retrieving the char- 
acteristics of the multimedia contents accumulated 
in the database to thereby automatically retrieve the 
user desired contents coincident with the prefer- 
ence of the user. 

6. The multimedia contents extraction system accord- 
ing to claim 1 , 2 or 5, wherein the contents storage 
supply portion (3) is comprised of a multimedia 
broadcast system (11) for broadcasting a plurality 
of multimedia contents and the user terminal device 
(2) is comprised of a multimedia broadcast receiver 
portion (1 0) for automatically and selectively receiv- 
ing the user desired contents coincident with the 
preference of the user among from the multimedia 
broadcast contents transmitted from the multimedia 
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broadcast system (11). 

7. The multimedia contents extraction system accord- 
ing to claim 6, wherein the multimedia broadcast 
receiver portion (1 0) is connected to the multimedia 5 
broadcast system (11) and the multimedia broad- 
cast receiver portion (10) is loaded with the user 
characteristic data recording medium (1) to input 
the user characteristic data and automatically 
choose the user desired contents among from the io 
multimedia broadcast contents using the inputted 
user characteristic data as a retrieval keyword so 
that automatic personalized extraction of the con- 
tents for the user preference is performed based on 

the retrieval results. 15 

8. The multimedia contents extraction system accord- 
ing to claim 1, 2 or 5, wherein the contents storage 
supply portion (3) is comprised of a contents supply 
portion (13) including a database (3a) accumulating 20 
a plurality of multimedia contents to be extracted, 
and the user terminal device (2) is comprised of a 
contents receiver portion (12) for receiving the mul- 
timedia contents transmitted from the contents sup- 
ply portion (13), wherein the contents supply 25 
portion (13) reads the user characteristic data 
inputted to the contents receiver portion (12) there- 
from and selects the user desired contents using 
the inputted user characteristic data as the retrieval 
keyword, whereby the selected user desired con- 30 
tents are transmitted to the contents receiver por- 
tion (12) from the contents supply portion (13). 

9. The user characteristic data recording medium (1) 
according to claim 3, wherein the user characteris- 35 
tic data previously recorded on the user character- 
istic data recording medium (1) is inputted to the 
multimedia broadcast receiver portion (10), 
whereby the multimedia broadcast receiver portion 
(10) automatically retrieves the multimedia broad- 40 
cast contents using the inputted user characteristic 
data as a retrieval keyword identifying characteris- 
tics of the multimedia broadcast contents which are 

of interest to the user, and, based on the retrieval 
results, the user desired contents are automatically 45 
selected among from the multimedia broadcast 
contents transmitted from the multimedia broadcast 
system (11). 

10. The multimedia contents extraction system accord- so 
ing to claim 1,2,5,6,7,8 or 9, wherein the user char- 
acteristic data is comprised of at least one 
combination of nationality, address, sex, age, occu- 
pation, field of specialty, hobby, special skill, family 
constituent and annual income. 55 



tic data is comprised of at least one combination of 
nationality, address, sex, age. occupation, field of 
specialty, hobby, special skill, family constituent and 
annual income. 

2. The multimedia contents extraction method accord- 
ing to claim 4, wherein the user characteristic data 
is comprised of at least one combination of nation- 
ality, address, sex, age, occupation, field of spe- 
cialty, hobby, special skill, family constituent and 
annual income. 

3. The multimedia contents extraction system accord- 
ing to claim 10, wherein the user characteristic data 
includes data of audiovisual extraction history of the 
contents. 

4. The multimedia contents extraction system accord- 
ing to claim 13, wherein the data of the audiovisual 
extraction history includes a characteristic data set 
in each contents and wherein the contents coinci- 
dent to any of the characteristic data set are not 
selected. 

5. A multimedia contents extraction method compris- 
ing: 

inputting user characteristic data indicative of 
preference of a user; . 

searching multimedia contents desired by the 
user among a plurality of multimedia contents 
accumulated in a multimedia database using 
the inputted user characteristic data as a 
retrieval keyword so that automatic personal- 
ized extraction of the contents for the user pref- 
erence, is performed based on the retrieval 
results. 



11. The user characteristic data recording medium (1) 
according to claim 3, wherein the user characteris- 
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